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Abstract 


-  )A  frequency  domain  approach  to  identifying  a  polynomial  response  model 

/t>*  •  *  ->-•  •" •**■>.  >  r  . 

for  a  system  i-s  presented  l  n  -t-Schrube-n-^nd  Cogl  l  ano;  1 98^1 .  Frequency  domain 
experiments  cbd  help  identify  important  input  factors  (or  parameters)  and 
interactions  in  systems  there  one  can  change  factor  values  during  an 
experimental  trial  and  observe  the  response  at  periodic  intervals.  An  example 
of  such  a  system  is  a  simulation  run  on  a  computer.  In  this  paper  ae  consider 
the  relationships  betmeen  spectral  amplification,  input-output  correlation, 
and  factor  values  for  such  experiments.  Conditions  are  also  given  for  ahich 
the  frequency  domain  approach  is  equivalent  to  ranking  prospective  terms  in  a 


response  model  by  their  correlation  nith  the  output. 
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V _ The  I'rrqurnry  Domain  Approach 


A  goal  of  many  cipmurnU  is  to  identify  e  inode)  describing  hou  a 
response  depends  ori  some  factors.  The  conventional  approach  require:,  many 
experimental  trials,  mth  factor  values  prescribed  by  an  experimental  design 
and  remaining  fixed  during  each  trial  Classical  experimental  designs,  ahere 
each  design  point  requires  a  separate  trial,  are  quite  expensive  ahen  there 
are  several  factors. 

A  frequency  domain  experimental  approach  is  possible  ahen  one  has  control 
over  the  factors.  Here  the  factors  oscillate  during  a  trial.  In  some  classes 
of  systems  each  important  factor's  oscillation  induces  response  oscillations 
at  predictable  frequencies.  Spectra)  analysis  can  be  used  to  detect  response 
oscillations,  determine  ahich  factors  or  interactions  are  responsible,  and  thus 
identify  a  response  model. 

The  goal  of  the  frequency  domain  approach  is  to  identify  the  important 
terms  in  a  polynomial  model  of  the  response. 
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An  alternative,  more  modest  goal  could  be  to  determine  nhether  a  linear  model 


is  mU  quoU  or  whethn  higher  powers  and  1  nt  rrat  tion»  air  present 


This  kind 


id  information  can  h<  1 1>  to  focus  attention  on  iW'portnnt  factor:.,  to  sn-prn 
unimportant  factors  from  further  rnnsi  drrat  i  on,  and  to  design  t  ut  ut  e  studies 
more  effectively. 

The  frequency  domain  approach  can  be  used  to  identify  a  model  for  systems 
in  which 

1.  Parameter  settings  CBn  be  changed  during  an  eipenmental  trial. 

2.  The  response  can  be  observed  at  periodic  intervals. 

3.  The  response  can  be  adequately  modeled  as  a  tune-invariant  linear 

combination  of  products  of  powers  of  the  factors.  That  is:  Given 

p  factors  observed  at  equally  spaced  intervals 

*i<t  (  i =1 , .  .  .  ,  p) 

we  can  form  q  polynomial  terms  by  taking  products  of  powers  of  the 
factors 


t 


JT 


n  J  <  0  =  1,  .  .  .  ,  q) 
1  =  1 


(  a 


10 


some  non-negative  integer) 


The  response  is  a  time-invariant  linear  combination  (filter)  of  these 
terms  and  noise  that  is  independent  of  the  factors, 


-3 


Such  a  system  inn  !>c  thought  of  as  b  Meek  1*»  •  ■  (Figure-  1)  mlti  two  t  y  |>*  f- 
of  input  determi  ni  M  i  r  factors,  Bhich  may  change  during,  an  eiprnmpntel 
trial,  and  random  no  isr  Whatever  sprian  of  values  a  rr  assigned  to  thr 

factors,  thr  rulr  for  forming  thr  response  remain’,  unchanged 

Figure  1 

A  System  Suitable  for  the  Frequency  Domain  Approach 


A  simulation  computer  program  is  an  important  special  class  of  systems 
■here  the  frequency  domain  approach  is  applicable  Simulation  models  are 
often  computer  programs,  Bhich  can  be  Britten  to  change  factor  settings  and 
periodically  record  the  response.  If  the  response  can  be  modeled  as  a 
polynomial  function  of  the  factors  (at  least  in  the  region  of  inte-est),  then 
all  three  requirements  are  met  and  the  frequency  domain  approach  should 
identify  a  response  model. 

The  next  section  of  this  paper  gives  the  input-output  spectrum 
relationship  applicable  to  general  polynomial  response  models.  Section  3 
gives  the  relationships  betBeen  spectrum  amplification,  input-output 
correlations,  and  response  model  coefficients. 


1 


Thr  frequency  domain  approach  to  model  identification  usrs  oscillation 
frequencies,  not  experimental  trials,  as  the  ex pr r  1  me nth)  unit.  Sihre  many 
oscillation  frequencies  arc  available  in  an  experimental  trie),  many  factors 
can  be  screened  in  one  trial.  This  advantage  can  best  be  demonstrated  in  a 
linear  system  with  added  noise,  in  ahioh  the  response  it  a  linear  function  of 
one  factor.  This  is  a  special  case  of  the  model  of  Equation  ?. 

Denote  the  linear  system  by 


yT  =  J  Hk  Vk  4  S 

h=  -ot 


■  here  y  ,  z  ,  h^,  and  t  are  as  in  Equation  2.  The  response  spectrum 
f  (w)  and  the  factor  spectrum  f^tul)  are  related  by 


fy(u)  a  G<'(u)fx(ul  ♦  f£(u) 


■here  G<  w) ,  called  the  gain,  describes  ho»  the  linear  system  amplifies  or 


attenuates  oscillations  at  different  frequencies.  The  gain  is  zero  and  there 
is  no  oscillation-induced  peak  if  the  response  does  not  depend  on  the  factor. 
Suppose  the  factor  oscillates  »ith  amplitude  a  and  frequency  u 


=  o  cos  271(01. 


Then  the  factor  spectrum  has  a  peak  at  to.  From  Equation  3  the  response 
spectrum  also  has  a  peak  at  to.  scaled  by  the  gain  at  to  and  masked  by  the 
noise.  A  response  spectrum  peak  at  to  is  evidence  that  the  factor  affects  the 
response;  no  peak  is  evidence  that  it  does  not. 


Consider  next  a  multiple-factor  linear  system 
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Here  the  response-  spectrum  and  lhr  factor  spectra,  f  ( u)  ,  are  related  by 


f  <u) 

y 


'  ? 

I  g  (u)  r  (u) 

i  =  i  i 


«  fjfW) 


(  14) 


where  each  G^u)  is  the  gain  for  oscillations  of  *  Suppose  each  factor 
x^  oscillates  at  the  frequency 

=  0^  cos  2Tiai  T .  (  b> 

Then  the  factor  spectrum  f^  ( u)  has  a  peak  at  .  If  G^u^)  is  not  zero, 

the  response  spectrum  has  a  peak  at  or  .  A  response  spectrum  peak  at  is 

evidence  that  xj  affects  the  response;  no  peak  is  evidence  that  it  does  not. 

As  shon  in  the  reference,  the  presence  of  a  higher  order  term  or  factor 
interaction  in  a  general  polynomial  response  surface  is  equivalent  to  several 
additional  1 i near  terms.  For  example,  a  second  order  term  (the  square  of  a 
factor  or  a  tuo  factor  interaction)  in  the  response  surface  model  has  exactly 
the  same  effect  as  t*o  additional  linear  terms.  Each  of  these  equivalent 
linear  terms  oscillate  at  one  of  the  frequencies  in  the  indicator  frequency  set 
that  corresponds  to  the  particular  higher  order  term.  These  term  indicator 
frequencies  are  easily  deteremined  and  the  experiment  can  be  designed  to  make 
them  unique  This  means  that  the  input-output  spectrum  relationship  given  by 
(14)  is  applicable  to  general  polynomial  response  surfaces  as  sell  as  the 
linear  response  case. 


Spectrum  Amplification.  Input-Output  Correl a ti ons.  and  Mode)  Coefficients 
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7hr  heights  of  spectrum  praks  art-  trialed  to  the  coefficients  of  l  hr 
irspntiM  model 
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To  demonstrate  this,  start  nth  the  relationship  between  the  response  tpectrurr, 
and  the  factor  spectra  in  a  multiple-factor  linear  system  with  Bdded  noise 
(  Equat l on  M) , 


f  (co) 
y 


y  2 

l  g  ( to) f  (u)>  4  r,(u). 
1=1  1  *i 


Since  the  gain  G  ^  C  co)  is  scaled  by  the  coefficient  £  ,  then 

( CO)  =  6igjUo) 


for  some  function  g^fCO).  Since  oscillates  as  a  sinusoid  with  amplitude 

(>i  and  frequency  co^,  then 


fjlco) 

l 


S(  (01 ) 


where  sfco^)  is  the  spectrum  of  a  sinusoid  with  frequency  co  and  amplitude 
1;  it  has  a  sharp  peak  at  .  Substituting  these  into  Equation  U, 


f  (co) 
y 


2,  ,  2 

glUo)ais(fe,1) 


+  f  (  CO)  . 
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If  we  assume  that  the  argument 


modulo  2T,  ( t 


1 , .  .  .  ,  n)  f  ron 


Equation  •>  is  sampled  uniformly  bHipen  C»  end  2v ,  thru  the  variance  r,| 

x  l  r. 
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The  experiment  is  designed  so  that  input  factors  oscillate  at  different 
frequencies.  If  these  frequencies  are  selected  such  that  the  correlation 
between  factor  values  is  zero,  then  the  correlation  between  and 

(T  =  1,  .  .  .  ,  n)  is 


Substituting  the  above  into  the  general  response  relationship,  expression  (  14)  , 
gi  ves 


f  (U) 

y 


2  2, 
f>1  gjtW) 


s(  U)J  ) 


+  f£(CJ)  . 


2  2  2 

This  shows  that  the  height  of  the  peak  at  tv  is  scaled  by  20yci ( to) . 

2  2 

The  relative  heights  are  proportional  to  p ^ g ^ ( co) .  If  the  gain  g1(u)  is 

constant  for  every  xj  and  u,  then  the  heights  of  the  peaks  are 
2 

proportional  to  p^.  Therefore  ranking  the  factors  according  to  the  heights 
of  their  peaks  is  equivalent  to  ranking  the  factors  according  to  the  magnitude 
of  their  correlations  with  the  response.  Techniques  for  dealing  with  non¬ 
unform  system  gain  are  presented  in  the  reference. 

To  compensate  for  the  oscillation  amplitudes,  divide  the  heights  of  the 


peaks  by  the  square  of  the  amplitudes.  These  are  proportional  to 


7 hr r  i  f  on  re nk  1  ng 


o' 

] 

p 

If  the  gain  )  *,  constant,  then  these  art  proport  1  one )  to  t 
the  factors  according  to  the  height*  of  their  peak*,  divided  by  t  ht  square.*,  of 
their  oscillation  amplitudes  it  equivalent  to  ranking  the  factors  according  to 
the  magnitude  of  their  coefficients. 

There  are  several  technical  problems  with  applying  frequency  domain 
experiments.  These  include  system  gain  Bnd  random  noise  as  aell  as  the  design 
problem  of  selecting  input  frequencies  and  amplitudes.  Techniques  for  solving 
these  problems  and  statistical  methods  for  identifying  significant  response 
model  terms  appear  in  the  reference.  In  that  paper  several  examples  ere  also 
presented. 
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